Interactive electronic device with optical page identification system

ABSTRACT

An electronic learning device for receiving a book having a plurality of successive page spreads, at least one page spread having selectable content and an optically readable page identifier. The device includes a housing configured to receive the book, a position sensor in the housing configured to determine the location of the selectable content on the at least one page spread, an optical sensor in the housing configured to irradiate and detect the page identifier on the at least one page spread and control electronics in the housing operatively coupled to the optical sensor and to the position sensor and configured to synchronize operation of the position sensor and the optical sensor.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Divisional Application of pending U.S. patentapplication Ser. No. 10/767,321 filed Jan. 29, 2004, which isincorporated herein by reference, and which claims the benefit of U.S.Provisional Patent Application No. 60/443,967, filed Jan. 31, 2003.

BACKGROUND OF THE INVENTION

The present invention relates to an optical page identification systemfor an interactive, electronic system using books. More particularly,the present invention relates to an autonomous, opticalpage-identification system that communicates to the system controllerthe identity of the page that is viewable by the user.

Certain interactive, electronic systems allow a child to activateelectronic speech, sound and lights by pointing to words or images onthe cover and pages of multi-page books used with a reader or base unit.The principle components of the typical system are the base unit housingsystem electronics, one or more books each removably mountable in thebase unit, for an example in a book well, and a read only memory(“ROM”), either within the base unit or within cartridges removablyconnected with the base unit and storing software associated with thecontent of the books. In addition to book-based activity, letters of thealphabet, numerals or other graphics may be provided on the upwardlyfacing surface of the base unit to allow alphabet, number or graphicsbased learning or game play when a book is not present in the unit.

The conventional hardware for the implementing the aforementionedsystems is generally not user friendly. A hardwired stylus or difficultto press pressure sensitive switches are provided to identify the pagebeing viewed and to select the interactive content on the viewed page.This conventional hardware usually requires an undesirable amount ofassistance, instruction and practice before a child can knowledgeablyand properly use the system, particularly pre-school children. Forexample, to identify a currently viewable page or to detect a page turn,a child must be instructed to recognize and then touch on the page auniquely positioned printed identification icon, such as a graphichaving a particular geometric shape or an easily recognizable key wordsuch as the word “Go”. The systems are also error prone due to thepositional certainty of the pages of the book on the reader. The systemsare also prone to user induced errors such as failure to identify orproperly select the page identification icon before interacting with apage or turning of multiple pages at once or the partial turning of apage. Accordingly, the current page identification and synchronizationmethods employed by conventional book interaction systems result in alarge percentage of synchronization errors for young users.

An autonomous page identification system that communicates to the systemcontroller the identity of the page that is viewable by the user withoutrequiring user intervention provides a user friendly system. Moreparticularly, an autonomous page identification system reducing oreliminating page synchronization errors will significantly increase thevalue of other, conventional aspects of such systems to usersparticularly pre-school users.

BRIEF SUMMARY OF THE INVENTION

In a first aspect, the invention is an electronic learning device forreceiving a book having a plurality of successive page spreads. At leastone page spread has selectable content and an optically readable pageidentifier. The device comprises a housing configured to receive thebook. A position sensor is in the housing. The position sensor isconfigured to determine the location of the selectable content on the atleast one page spread. An optical sensor is provided in the housing. Theoptical sensor is configured to irradiate and detect the page identifieron the at least one page spread. Control electronics in the housing areprovided, the control electronics being operatively coupled to theoptical sensor and to the position sensor, and the control electronicsbeing configured to synchronize operation of the position sensor and theoptical sensor.

In a second aspect, the invention is an electronic learning devicecomprising a page having an optical identification code and selectablecontent. A housing is configured to support the page. An integratedsensor system is configured to irradiate and detect the opticalidentification code and to detect the location of the selectablecontent. Control electronics in the housing are operatively coupled tothe integrated sensor system and configured to synchronize theirradiation and detection of the optical identification code and thedetection of the location of the selectable content and to produce anaudible response associated with the selectable content when the page issupported by the housing and the selectable content is selected.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The foregoing summary, as well as the following detailed description ofpreferred embodiments of the invention, will be better understood whenread in conjunction with the appended drawings. For the purpose ofillustrating the invention, there are shown in the drawings embodimentswhich are presently preferred. It should be understood, however, thatthe invention is not limited to the precise arrangements andinstrumentalities shown.

In the drawings:

FIG. 1 is a schematic block diagram of an interactive electroniclearning system having an autonomous page identification system inaccordance with the present invention;

FIG. 2 is a top perspective view of the main components of theelectronic learning system schematically illustrated in FIG. 1;

FIG. 2A is an enlarged top plan view of an emitter-detector pair of thepage identification system of the electronic learning system of FIG. 2;

FIG. 3 is a cross-section view of the emitter-detector pair of FIG. 2A,taken along line 3-3;

FIGS. 4A through 4G are a series of top plan views of an upper portionof a book of the electronic learning system of FIG. 2, showing severalof a plurality of page spread configurations of the book and alsoshowing in particular closed-hole and open-hole locations forming pageidentifiers corresponding to each of the several page spreadconfigurations;

FIG. 5 is a table summarizing the status of hole locations forming eachof the plurality of page identifiers corresponding, respectively, toeach of the plurality of page spread configurations of the book of theelectronic learning system of FIG. 2;

FIGS. 6A through 6G are a series of bottom plan views of the portion ofthe book of FIGS. 4A through 4G, as seen by a plurality ofemitter-detector pairs when the book is operatively installed in anelectronic learning device of the electronic learning system of FIG. 2;

FIG. 7 is a table summarizing the status of hole locations forming eachof the plurality of page identifiers as seen by the plurality ofemitter-detector pairs when the book is operatively installed in theelectronic learning device of FIG. 2;

FIG. 8 is a block diagram of control electronics of the pageidentification system of FIG. 1;

FIG. 9 is a top plan view of an upper portion of an alternate embodimentof the book of the electronic learning system of FIG. 2, showing one ofa plurality of page spread configurations of the book and illustratingan alternative embodiment of closed-hole and open-hole locations formingpage identifiers corresponding to each of the several page spreadconfigurations;

FIG. 10 is a top plan view of an upper portion of another alternateembodiment of the book of the electronic learning system of FIG. 2,showing one of a plurality of page spread configurations of the book andillustrating another alternative embodiment of closed-hole and open-holelocations forming page identifiers corresponding to each of the severalpage spread configurations;

FIG. 11 is a plan view of a preferred embodiment of one of the sensormatrices comprising a preferred embodiment of the position sensor; and

FIG. 12 is a cross-sections view of a preferred embodiment of theposition sensor.

DETAILED DESCRIPTION OF THE INVENTION

Certain terminology is used in the following description for convenienceonly and is not limiting. The words “right,” “left,” “lower” and “upper”designate directions in the drawings to which reference is made. Thewords “inwardly” and “outwardly” refer to directions toward and awayfrom, respectively, the geometric center of an interactive, electroniclearning system having an optical page identification system inaccordance with the present invention, and designated parts thereof. Theterminology includes the words noted above, derivatives thereof andwords of similar import.

Referring to FIGS. 1-10, there are shown preferred embodiments of theinvention in the form of an interactive, electronic learning system,generally designated 10. The electronic learning system 10 includes anelectronic learning device or base unit 20, and one or more books 60.Given the limitations of present consumer electronics, the system 10 mayinclude one or more ROM cartridges 50, or other form mass electronicdata storage, that can be removably connected with the base unit 20. Theelectronic learning device 20 also includes an integrated sensor system100 (FIG. 8) having a position sensor 110 and, according to the presentinvention, an optical sensor system 120. With the exception of theintegrated sensor system 100 disclosed in detail below, the electroniclearning system 10 has substantially the same features as the electroniclearning systems which are the subject of co-pending U.S. Patentapplications filed by the assignee of the present invention. Theco-pending applications are U.S. patent application Ser. No. 10/448,581(Pub. No. 2004-0076935 A1), “Method for Teaching Linguistics”; U.S.patent application Ser. No. 10/448,582 (issued on Apr. 10, 2007 as U.S.Pat. No. 7,203,455 B2), “Interactive Multi-Sensory Reading SystemElectronic Teaching/Learning Device”; and U.S. patent application Ser.No. 10/448,583 (Pub. No. 2004-0043365 A1), “Electronic Learning Devicefor an Interactive Multi-Sensory Reading System”, all having filingdates of May 30, 2003. The disclosures of these co-pending applicationsand that of Provisional Application No. 60/443,967 related hereto arehereby incorporated herein by reference.

With reference now to FIGS. 1 and 2, the electronic learning system 10includes the electronic learning device 20 for receiving the book 60having a plurality of successive page spreads. As discussed below, atleast one page spread of the book 60 has an optically readable pageidentifier. Additionally, at least one page of the book 60 hasselectable content (not shown). The selectable content may be, forexample, graphics disposed on the at least one page.

The electronic learning device 20 comprises a housing 22 configured toreceive the book 60. The housing 22 includes a left hand portion 24 anda right hand portion 26. The two portions 24, 26 are hinged together bya hinge 28. A handle 30 is provided to allow the electronic learningdevice 20 to be conveniently transported when the left and right handportions 24, 26 are placed in a closed position. Each portion 24, 26includes a recess. The two recesses together form a book well 32 sizedand shaped to releaseably receive the book 60. The artisan willappreciated by that changes could be made to the configuration of thehousing 22 without departing from the broad inventive concept of theinvention. For example, the housing 22 can have a unitary constructionwithout a hinge. Further the housing 22 can have a substantially planarsurface for receiving a book instead of a book recess.

The electronic learning device 20 includes an on/off switch 34. Theelectronic learning device 20 includes a speech generator 36; a soundoutput device, such as a speaker 38; displays, such as light emittingdiodes 40; and base unit memory 44, all operatively connected to acontroller 42. The controller 42 may include a general-purposemicrocontroller, such as SUNPLUS™ Part No. SPL130A, or the like. A powersupply 46 provides power to the electronic components of the electroniclearning device 20. Preferably, the power supply 46 is provided bydry-cell or rechargeable batteries stored within the housing 22.

Referring to FIGS. 1 and 8, the integrated sensor system 100 comprises aposition sensor 110 and an optical sensor 120 operatively coupled tosensor electronics 130 controlled by the controller 42. In a preferredembodiment, the position sensor 110 comprise a plurality of at leasttouch-responsive, mutually adjoining sensors organized in atwo-dimensional array. The array is formed by separate and separatedfirst and second sets of generally parallel, individual conductive linestransversely crossing over each other beneath an upper surface of thehousing 22. Further description of the array may be found in co-pendingU.S. Pat. No. 7,203,455 B2. A signal oscillator 132 is cyclicallycoupled to individual conductive lines of the first set of conductivelines. A synchronous detection circuit 150 is operatively coupled withthe signal generator 132 and with individual conductive lines of thesecond set of conductive lines to identify user selected individualcross-points of the first and second sets of lines of the array. Inother embodiments of the invention, the position sensor 110 can be anyposition sensor suitable for use with an electronic learning device,such as those described in U.S. Pat. No. 5,686,705 and U.S. Pat. No.6,661,405, and that is adaptable for operation with the optical sensor120.

The two-dimensional array comprising the position sensor 110 preferablyis partitioned into a left-hand sixteen by sixteen sensor matrix 112 anda right-hand sixteen by sixteen sensor matrix 114 (FIG. 8), respectivelypositioned in the corresponding left hand portion 24 and right handportion 26 of the housing 22. Each sensor matrix 112, 114 has row andcolumn conductive lines, represented schematically in phantom in FIG. 2.The sensor matrices 112, 114 are adapted to detect the proximity of auser's finger. Thus, the position sensor 110 is configured to determinethe location of the selectable content on the at least one page spreadwhen a user places a finger proximate selectable content overlaying thesensor matrices 112, 114.

FIG. 11 shows the left-hand matrix 112 in accordance with an exemplaryembodiment of the present invention. The right-hand matrix 114 issuggestedly a mirror image but could be of a different configuration andconstruction. Each matrix 112, 114 suggestedly includes sixteen rows 101r and sixteen columns 101 c of the conductive lines or traces howeverdifferent numbers of either or both can be used. Each point where a row101 r and column 101 c line cross creates a single individual“cross-point” sensor. The sixteen by sixteen line arrays thereforecreate two hundred and fifty-six individual cross-point sensors arrangedin a rectangular array in the recesses of the left-hand portion 24 andright hand portion 26 of the housing 22.

The individual traces 101 r, 101 c are extended to side and bottom edgesof an electrically insulative support sheet 102, for example a Mylarplastic sheet. Preferably, shorter traces 103 and 104 are extended fromthe side and bottom edges, respectively, of the sheet 102, one shortertrace 103 or 104 on either side of each sensor trace 101 r or 101 c,respectively. The shorter traces 103 and 104 are all connected to systemground through or with the conductive plane 105. The horizontal traces104 extend inwardly from the vertical edge to just beyond where the rowtraces 101 r widen out to form terminals and, with a uniform length,provide some impedance control. The vertical traces 103 extend from thebottom edge up to a point where the vertical traces 101 c begin to runparallel, just below where those traces are flared and to within aboutone-half inch (12 mm) of the lowest cross-points. Traces 103 preventcross coupling between the column traces 101 c when the columns arebeing driven by oscillator 132.

FIG. 12 shows an example of the cross-sections of the position sensorand depicts a plastic spacer 106, a plurality of the spaced apart column(vertical) traces 101 c, the non-conductive (e.g. Mylar) sheet 102 andone of the spaced apart row (horizontal) traces 101 r transverse to theplurality of column traces 101 c. The non-conductive sheet 102 supportsand separates the column traces 101 c from the row traces 101 r andforms with those traces arrays 112, 114. The sensor preferably includesa conductive plane 105 in the form of a metal plate, connected to systemground and parallel to and spaced away from the arrays 112, 114.

With reference now to FIGS. 1-3, the optical sensors 120 comprise anarray of preferably identical optical emitter and optical detector pairsindicated collectively at 122. Seven individual pairs 122 a-122 g arelocated in the left hand portion 24 and seven more 122 h-122 n arelocated in the right-hand portion 26. The radio frequency oscillatingsignal generator 132 is cyclically coupled to each individual opticalemitter 124 and the synchronous detection circuit 150 is operativelycoupled with each individual optical detector 126 of each pair 122.Preferably, the emitter-detector pairs 122 are mounted upwardly facingin the upper margin of the left portion 24 and right portion 26 of thebook well 32. Preferably, but not necessarily, the optical emitters 124and optical detectors 126 operate in the infra red (IR) portion of theelectromagnetic spectrum. However, the emitter-detector pairs 122 couldoperate at other wavelengths without departing from the scope of theinvention.

In the preferred embodiment shown in FIG. 2, a total of fourteenemitter-detector pairs 122 are provided and are connected to a circuitboard 128 included as part of the control electronics in the housing 22.The number of emitter-detector pairs 122 may by more or less thanfourteen and is determined by the number of hole locations encoding thepage identifiers in the book 60 as will be described. The spacingbetween the emitter-detector pairs 122 may be uniform or non-uniformprovided that they are positioned to be in registry with correspondinghole locations in each book 60. Accordingly, the fourteenemitter-detector pairs 122 are positioned at locations corresponding tofourteen potential hole locations 72 a through 72 n in each book 60 inuse, as will be described with respect to FIGS. 4A-7, such that eachemitter-detector pair 122 a through 122 n has within its field of viewthe hole location 72 a through 72 n with which it corresponds.

With reference now to FIGS. 1 and 8, the sensor electronics 130 areoperatively coupled to the optical sensors 120, the position sensor 110,and the controller 42. The sensor electronics 130, in conjunction withthe controller 42 and memory 44, form a set of control electronicsconfigured to synchronize operation of the position sensor 110 and theoptical sensor 120. The sensor electronics 130 include the signaloscillator 132, a column driver circuit 134, a first sensor circuit 144operatively coupled with the left-hand position sensor matrix 112 and asecond sensor circuit 146 operatively coupled with the right-handposition sensor matrix 114.

The sensor electronics 130 further include first and second opticalemitter circuits 136, 138, respectively, each operatively coupled toseven optical emitters 124; first and second optical detector circuits140, 142, respectively, each operatively coupled to seven opticaldetectors 126; a row select circuit 152; the synchronous detector,multiplexer and filter 150; an optical switch and gate 148; and ananalog to digital (A/D) signal converter 154.

The electronic learning system 10 further preferably comprises cartridge50. In a preferred embodiment, the cartridge 50 is operatively coupledto the controller 42 by removably inserting the cartridge 50 into theelectronic learning device 20. The cartridge 50 is preferably uniquelyassociated with the book 60. A plurality of cartridge 50 and book 60sets may be provided. The cartridge 50 has memory 54 operativelyconnected to cartridge control circuitry 52. Alternatively, thecartridge 50 could provide only memory 54. Stored in the cartridgememory 54 is software and/or data associated with the content of thebook 60.

Turning now to FIGS. 2 and 4A-7, each book 60 is encoded for opticalpage identification by the sensors 122. The book 60 comprises aplurality of pages and a plurality of successive page spreads defined bythe pages. Each page spread is defined either by one side of a page(i.e. outer cover of a closed book) or by both a second (left or evennumbered) side of a first page and a first (right or odd numbered) sideof a second page. In this illustration, the book 60 comprises fourteenpages and fifteen page spreads but may have more or less than fourteenpages and corresponding page spreads without departing from the scopeand spirit of the invention. The plurality of pages is preferablyconnected by a spine 66 or any other well known binding.

FIGS. 4A-4G depict various page spreads from an exemplary fourteen pagebook 60. Each of the fourteen pages is identified by reference numerals62: 62 a-62 n. Each of the two sides of each page is represented bynumerals 64: 64 a for the first side (odd numbered page) and 64 b forthe second side (even numbered page). Page spreads are identified byreference numerals 68: 68 a-68 o for the fifteen spreads by fourteenpages. FIGS. 4A-4G represent various page spreads as the spreads areseen by the user, that is top plan views of the book 60 and the spreads122.

With reference to FIG. 4A, in the preferred embodiment of the book 60, afirst page spread 68 a is formed by a first side 64 a of a first page 62a. This is a closed book lying on its rear cover. With reference toFIGS. 2 and 4B, a second page spread 68 b is formed by a second side 64b of the first page 62 a and a first side 64 a of a second page 62 b.With reference to FIGS. 4C-4G, a third page spread 68 c is formed by thesecond side 64 b of the second page 62 b and the first side 64 a of athird page 62 c (FIG. 4C); an eighth page spread 68 h is formed by thesecond side 64 b of the seventh page 62 g and the first side 64 a of aneighth page 62 h (FIG. 4D); a ninth page spread 68 i is formed by thesecond side 64 b of the eighth page 62 h and the first side 64 a of aninth page 62 i (FIG. 4E); a tenth page spread 68 j is formed by thesecond side 64 b of the ninth page 62 i and the first side 64 a of atenth page 62 j (FIG. 4F); and a fifteenth page spread 68 o is formed bythe second side 64 b of a fourteenth page 62 n (FIG. 4G). Fourth throughseventh and eleventh through fourteenth page spreads of the book 60 arenot illustrated, but are page spreads formed by the second (or left)side and the first (or right) side, respectively, of corresponding pagessimilar to the page spreads 68 b-68 c and 68 h-68 j shown in FIGS.4B-4F.

The book 60 further comprises a plurality of page identifiers 82 a-82 owhich are integral in the book 60. Each page identifier is uniquelyassociated with a corresponding page spread. Each page spread isuniquely encoded so as to be readable by an optical sensor systembeneath the book 60. The spreads are encoded by the provision or absenceof holes at predetermined location in the spreads, which overlieindividual sensors of a sensor system under the book 60. Each pageidentifier comprises a series of overlayable arrangements of open orclosed potential hole locations (hereinafter simply “hole locations”).In a preferred embodiment, the hole locations are positioned within anupper margin of each page to physically lie over the sensors 122 a-122o. Alternatively, the hole locations may be positioned within otherportions of each page and the sensors repositioned accordingly. As willbecome apparent form the discussion below, the number of hole locationsrequired for page identifier encoding is dependent on the number of pagespreads to be identified and in the preferred encoding scheme is lessthan half the number of page spreads.

In the illustrated embodiment, book 60 has fifteen page spreads,identified by reference numerals, collectively by 82 and 82 a-82 o forindividual spreads. Each page is provided with seven hole locations. Thefirst page spread 68 a and the fifteenth page spread 68 o correspond tothe closed book 60 lying on its back cover and its front cover,respectively, and thus are formed by a single page each having sevenhole locations. The page spreads between the first page spread 68 a andthe fifteenth page spread 68 o are two-page spreads and therefore havefourteen hole locations indicated by reference numerals, collectively by72 and individually at 72 a through 72 n (FIG. 2).

Each hole location is either an open-hole location 74, or a closed-holelocation 76. Optionally, one or more of the closed-hole locations 76 mayhave a foil 77 with an optical reflectance detectably different than theoptical reflectance of an area adjacent the closed-hole location.

Again, FIGS. 4A-4G depict top plan views of some of the spreads as seenby the user rather than the sensor. A first page identifier 82 acorresponds to the first page spread 68 a (FIG. 4A). The first pageidentifier 82 a is an encoding formed by seven of fourteen possible holelocations (eighth through fourteenth hole locations, 72 h though 72 n,in the first side 64 a of the first page 62 a), which are closed. Aclosed location will reflect light from the emitter 124 of each sensor122 so as to be detected by the detector 126 of each sensor pair124/126. A hole or no page over the sensor will not reflect light andwill not register on the sensor 122. As will be discussed shortly,various hole locations 72 a-72 o are eventually closed or covered.Preferably a metallic foil 77 is used to close a hole location facingopen holes in pages 68 adjoining and facing the closed hole to betterreflect light from a facing emitter 124 and raise the signal level fromthe detector 126 sensing the closed hole/foil. The eighth throughthirteenth hole locations 72 h through 72 m are locations of one or moreopen-holes 74. These overlying foils 77 (represented by a darkened holelocation) disposed on closed-hole locations 76 that are located onsuccessive pages beneath the topmost first page 62 a. As will bediscussed, these open hole 74 and closed hole 77 locations are inaccordance with the scheme in FIG. 5, as further discussed below. Thefourteenth hole location 72 n is a closed-hole 76 covered by a foil 77.

To summarize FIG. 4A, a user looking down at a closed book 60 on theright-hand side 26 of the device 20 is presented with seven potentialhole locations 72 h through 72 n. The user sees a foil 77 in eachlocation with a series of open holes overlying each foil 77 thatdecrease in number from left to right (72 h to 72 n) across the book 60.As will be discussed below, this arrangement occurs because each of thefirst seven pages 62 a-62 g has one foil 77 closed hole and one lessopen hole 76 than the page above it (i.e. previous page).

The encoding for the first page identifier 82 a (FIG. 4A) is bestunderstood in conjunction with the hole location status tabulation ofFIG. 5 in which open-hole locations 74 are indicated by the letter “O”,closed-hole locations 76 without a foil 77 are indicated by the letter“C”, and closed-hole locations 76 with a foil 77 are indicated by theletter “F”. (It should be understood that on some other page underlyingeach open hole location 74 is a foil 77.) For example, the hole locationstatus tabulation in FIG. 5 shows that a foil 77 is present at theeighth hole location 72 h of the first page spread 68 a on theunderlying seventh page 68 g. The foil 77 is visible in a top plan viewof the book 60 in page spread 68 a because an open hole is provided atthe eighth hole location 72 h in each of the first through sixth pages(68 a through 68 f) overlying the seventh page 68 g. Thus, as statedabove, the first page (or front cover) 62 a of the book 60 comprises sixopen-hole locations 74 (for eighth through thirteenth hole locations, 72h through 72 m) below each of which is a foil 77 at a successive closedhole location 76 on the successive corresponding underlying pages. Thefirst page 62 a further has only one closed-hole location 76 with a foil77 in the fourteenth hole location 72 n.

Referring to FIG. 4B and FIG. 5, a second page identifier 82 bcorresponds to the second page spread 68 b. The second page spread 68 bis a two-page spread. Accordingly, the second page identifier 82 b isencoded by fourteen hole locations. The first through seventh holelocations, 72 a through 72 g, are located in the upper margin of thesecond side 64 b of the first page 62 a. These hole locations are inmirror image registry with the hole locations, 72 h through 72 n, on thefirst side 64 a of the first page 62 a (FIG. 4A), and have in reverseorder the same open-hole and closed-hole encoding as the first side 64 aof the first page 62 a. The only difference is that the firstclosed-hole location 72 a of the second page identifier 82 b does nothave a foil 77 as does the corresponding fourteenth closed-hole location72 n on the first side 64 a of the first page 62 a. This is a result ofthe method of fabrication of the book 60. A foil 77 could have beenvisibly mounted in the first hole location 72 a of the second spread 68b. Indeed, any and every closed (C) location in FIG. 5 could be a foil(F) location and vice versa. The eighth through fourteenth holelocations, 72 h though 72 n, are located in the upper margin of thefirst side 64 a of the second page 62 b. The eighth through twelfth holelocations, 72 h through 72 l, are open-hole locations 74 in that page 62b. The thirteenth and fourteenth hole locations 72 m, 72 n areclosed-hole locations 76. The thirteenth hole location 72 m has a foil77. The portion of the encoding for the second page identifier 82 b onthe first side 62 a of the second page 62 b has one less open-holelocation 74 than the encoding for the first page identifier 82 a on thefirst side 64 a of the first page 62 a.

Referring to FIG. 4C and FIG. 5, a third page identifier 82 ccorresponds to the third page spread 68 c. The third page spread 68 calso is a two-page spread. Accordingly, the third page identifier 82 cis encoded by fourteen hole locations. The first through seventh holelocations, 72 a through 72 g, are located in the upper margin of thesecond side 64 b of the second page 62 b, are in mirror image registrywith the hole locations 72 h though 72, on the first side 64 a of thesecond page 62 b, and have, in reverse order, the same open-hole andclosed-hole encoding as the first side 64 a of the second page 62 b. Theclosed-hole location 72 b of the third page identifier 82 c does nothave a foil 77. The eighth through fourteenth hole locations, 72 hthough 72 n, are located in the upper margin of the first side 64 a ofthe third page 62 c. The eighth through eleventh hole locations, 72 hthrough 72 k, are open-hole locations 74 in the page 62 c. The twelfth,thirteenth and fourteenth hole locations 72 l, 72 m, 72 n areclosed-hole locations 76 in the page 62 c. The twelfth hole location 72l has a foil 77. The portion of the encoding for the third pageidentifier 82 c on the first side 64 a of the third page 62 c has oneless open-hole location than the encoding for the second page identifier82 a on the first side 64 a of the second page 62 b.

For brevity, the fourth through seventh page spreads for the book 60 arenot shown, as those skilled in the art will understand from the encodingof the fourth through seventh page identifiers, 82 d through 82 g, shownin FIG. 5, that the encoding for each successive page identifierdecreases in a total number of open-hole locations by at least oneopen-hole location and that the location of the foil shifts inwardly onehole position for each page 68 d-68 g.

Referring to FIG. 4D and FIG. 5, an eighth page identifier 82 hcorresponds to the eighth page spread 68 h. The eighth page spread 68 his a two-page spread having the eighth page spread identifier 82 hencoded by fourteen hole locations, each of which is a closed-holelocation 76. Those skilled in the art will understand that the eighthpage spread 68 h is a separator page that partitions the encoding schemeof the present invention into a first sequence of page identifierscomprising an overlayable arrangement of open-hole and closed-holelocations in which each successive arrangement of the first sequencedecreases in a first total number of open-hole locations by at least oneopen-hole location, as discussed above, and a second sequence of pageidentifiers comprising overlayable arrangements of open-hole andclosed-hole locations in which each successive arrangement of the secondsequence increases in a second total number of open-hole locations by atleast one open-hole location, as discussed below.

Referring to FIG. 4E and FIG. 5, a ninth page identifier 82 icorresponds to the ninth page spread 68 i. The ninth page spread 68 i isa two-page spread. Accordingly, the ninth page identifier 82 i isencoded by fourteen hole locations. The first through seventh holelocations, 72 a through 72 g, are located in the upper margin of thesecond side 64 b of the eighth page 62 h, are in mirror image registrywith the hole locations, 72 h though 72 n, on the first side 64 a of theeighth page 62 h, and are all closed-hole locations 76. The seventh holelocation 72 g is a closed-hole location 76 with a foil 77. The eighththrough fourteenth hole locations, 72 h though 72 n, are located in theupper margin of the first side 64 a of the ninth page 62 i. The eighthhole location 72 h is an open-hole location 74. The ninth throughfourteenth hole locations, 72 i through 72 n, are closed-hole locations76. The portion of the encoding for the ninth page identifier 82 i onthe first side 62 a of the ninth page 62 i has one more open-holelocation 74 (at 72 h) than does the encoding for the eighth pageidentifier 82 h on the first side 64 a of the eighth page 62 h (FIG.4D).

Referring to FIG. 4F and FIG. 5, a tenth page identifier 82 jcorresponds to the tenth page spread 68 j. The tenth page spread 68 jalso is a two-page spread. Accordingly, the tenth page identifier 82 jis encoded by fourteen hole locations. The first through seventh holelocations, 72 a through 72 g, are located in the upper margin of thesecond side 64 b of the ninth page 62 i, are in mirror image registrywith the hole locations, 72 a though 72 g, on the first side 64 a of theninth page 62 i (FIG. 4E), and have in reverse order the same open-holeand closed-hole encoding as the first side 64 a of the ninth page 62 i.The sixth hole location 72 f of the tenth page identifier 82 j is aclosed hole-location 76 with a foil 77. The eighth through fourteenthhole locations, 72 h though 72 n, are located in the upper margin of thefirst side 64 a of the tenth page 62 j. The eighth and ninth holelocation 72 h, 72 i are open-hole locations 74. The tenth throughfourteenth hole locations, 72 j through 72 n, are closed-hole locations76. The portion of the encoding for the tenth page identifier 82 j onthe first side 62 a of the tenth page 62 j has one more open-holelocation 74 than the encoding for the ninth page identifier 82 i on thefirst side 64 a of the ninth page 62 i (FIG. 4E).

For brevity, the eleventh through thirteenth page spreads for the book60 are not shown, as those skilled in the art will understand from theencoding of the eighth through tenth page identifiers, 82 h through 82j, shown in FIG. 5, that the encoding for each successive pageidentifier increases in a total number of open-hole locations by atleast one open-hole location. Also for brevity, the fifteenth pageidentifier 82 o (FIG. 4G) corresponding to the fifteenth page spread 68o has in reverse order substantially the same encoding as the first pageidentifier 82 a and is not further discussed.

With reference again to FIG. 5, the preferred embodiment of the book 60comprises a first (or front cover) page spread 68 a formed by the firstside 64 a of the first page 62 a, a fifteenth (or back cover) pagespread 68 o formed by the second side 64 b of the fourteenth page 62 n,and a plurality of successive page spreads 68 b-68 n therebetween.Preferably, the plurality of page spreads 68 b-68 n are formed by afirst (right or odd numbered) side of a first corresponding page and asecond (left or even numbered) side 64 b of a second corresponding page,such as the first side 64 a of the second page 62 b and the second side64 b of the first page 62 a forming the second page spread 68 b shown inFIG. 2.

Stated another way, the book 60 additionally comprises a first sequence78 of page identifiers 82 b-82 h (see FIG. 5). Each page identifier 82b-82 h is associated with a first corresponding page spread 68 b-68 h ofthe plurality of successive page spreads. The first sequence 78comprises overlayable arrangements of open-hole and closed-holelocations 74(0), 76(F/C), respectively. Each successive arrangement ofthe first sequence 78 decreases in a first total number of open-holelocations by at least one open-hole location 74. For example, as shownin FIG. 5, for the encoding of the first sequence 78 of page identifiers82 b-82 h for a fourteen-page book, the first total number of open-holelocations 74 decreases by two open-hole locations 74 for successivearrangements corresponding to the page identifiers 82 b-82 g associatedwith the second through seventh page spreads 68 b-68 g and by oneopen-hole location 74 for the succession from the seventh page spread 68g to the eighth page spread 68 h.

Those skilled in the art will understand from the encoding scheme shownin FIG. 5 that each arrangement of the first sequence of pageidentifiers has at least one closed-hole location on the first side 64 aof the first corresponding page of the first corresponding page spread.The at least one closed-hole location has a first optical reflectancedetectably different than a second optical reflectance of a first areaadjacent the at least one closed-hole location when provided with a foil77 in the hole location.

The book 60 additionally comprises a second sequence 80 of pageidentifiers 82 h-82 n. Each page identifier 82 h-82 n is associated witha second corresponding page spread 68 h-68 n of the plurality ofsuccessive page spreads. The second sequence 80 comprises overlayablearrangements of open-hole and closed-hole locations 74, 76,respectively. Each successive arrangement of the second sequence 80increases in a second total number of open-hole locations by at leastone open-hole location 74. For example, as shown in FIG. 5, for theencoding of the second sequence 80 of page identifiers 82 h-82 n for afourteen-page book, the second total number of open-hole locations 74increases by one open-hole location 74 for the succession from theeighth page spread 68 h to the ninth page spread 68 i and by twoopen-hole locations 74 for successive arrangements corresponding to thepage identifiers 82 i-82 n associated with the ninth through fourteenthpage spreads 68 i-68 n.

Those skilled in the art will understand from the encoding scheme shownin FIGS. 4A-5 that each arrangement of the second sequence 80 of pageidentifiers has at least one closed-hole location on the second side 64b of the second corresponding page of the second corresponding pagespread. The at least one closed-hole location has a third opticalreflectance detectably different than a fourth optical reflectance of asecond area adjacent the at least one closed-hole location. The artisanalso will understand from the discussion above that the difference inoptical reflectance detectability can by achieved by positioning of thefoil 77 or other reflective material at the corresponding oneclosed-hole location (72 g-72 a in sequence 80). Accordingly, the firstand third optical reflectances can be substantially the same. Similarly,the second and fourth optical reflectances can be substantially the samewithout departing from the spirit and scope of the invention. Stillfurther, the artisan will understand from the discussion below that thematerials or surface treatments provided at the closed-hole locationsand in the adjacent areas can be any combination of materials or surfacetreatments having the optical reflectance properties required to obtaina desired signal to noise ratio for the optical sensors, also discussedbelow.

In use, the electronic learning device 20 is activated using the on/offswitch 34, the cartridge 50 is coupled to the electronic learning device20, the book 60 is placed in the book well 32. The integrated sensorsystem 100 operates as subsequently described.

The signal oscillator circuit 132 generates a square wave signal havinga frequency of approximately 250 kHz at 3.3 V to the column drivercircuit 134. Corresponding pairs of the vertical column conducting linesof the position sensor matrices 112, 114 are excited sequentially fromone through sixteen with the square wave signal. The horizontal rowconducting lines of each of the matrices 112, 114 are scannedsequentially from one through sixteen during each excitation of onevertical column line. In this manner, each cross-point of the sensormatrices 112, 114 is measured individually. The row select circuit 152directs the sequential sensing of the sensor circuits 144, 146. Thesensor circuits 144, 146 detect signals on the row lines of the sensormatrices 112, 114 and forward the detected signals to the synchronousdetector, multiplexer and filter 150. Thereafter, the detected signalsare converted to digital signals by the A/D converter 154 and forwardedto the controller 42 for analysis.

The measured values of each cross-point are stored in a memory 44operatively coupled to the controller 42. When a finger or hand ispresent over the sensor matrices 112, 114, the value of signals receivedby the sensor circuits 144, 146 is reduced at the location of the fingeror hand over individual cross-points. By comparing successive full scansof the sensor matrices 112, 114 for the presence of a finger, theprecise location of the finger can be determined.

The optical emitter and detector circuits 136, 138, 140 and 142 areintegrated with the circuitry controlling the successive full scans ofthe sensor matrices 112 and 114 discussed above in the following manner.Control and synchronization of the optical emitter and detector circuits136, 138, 140 and 142 with the scanning circuits for the sensor matrices112, 114 is accomplished by the optical switch and gate 148 under thecontrol of the controller 42. The optical switch and gate 148 enablesand disables the row select circuit 152 to allow isolation andindependent control of the optical emitter and detector circuits 136,138, 140 and 142 and the row select circuit 152. Preferably, but notnecessarily, the optical emitter and detector circuits 136, 138, 140 and142 are activated after each full scan of the sensor matrices 112 and114.

Status of the emitter-detector pairs 122 corresponding to first throughfourteenth hole locations 72 a through 72 n of each book 60 iscommunicated to the controller 42 and decoded by the controller inaccordance with a decoding table located in the memory 44 to determinewhich page spread is visible to the user. For example, the pageidentifiers for the page spreads for the preferred embodiment of thebook 60 discussed above and coded in accordance with the encoding shownin FIGS. 4A-4G and FIG. 5 appear to the emitter-detector pairs 122 asshown in FIG. 6A-6G when the book 62 is in the book well 32 and aredecoded by the controller 42 in accordance with the decoding table shownin FIG. 7. FIGS. 6A-6G represent bottom plan views of the book 60, asseen by the optical detectors 126 a-126 n associated with opticalsensors 122 a-122 n, respectively, and are nearly mirror images of FIGS.4A-4G. The major difference is that foils are visible to the detectorswhere simple closed hole locations (C) are visible to the user (FIGS.4A-4G).

From this disclosure, the artisan will recognize that in addition to theabove-described encoding of page identifiers, other page identifiersassociated with a supplemental book (not illustrated) having, forexample, additional page spreads, may be encoded by arrangements of theopen-hole locations 74 and closed-hole locations 76 not used in thefirst through fifteenth page spreads. For example, with reference toFIG. 7, part of a third sequence 84 of page spreads and correspondingpage identifiers having open-hole 74 and closed-hole 76 status as showncan be provided. The page identifiers associated with the third sequence84 can be detected with the optical sensor 120 in a manner consistentwith operation of the first and second sequences page identifiers 78 and80 described above. Other unique page identifiers in addition to thoseassociated with the first, second and third sequences 78, 80 and 82 arepossible. These separate sequences can be used in separate books anddata for books having different sequences 78, 80, 84, etc. can be storedin the same cartridge 50.

Once the electronic learning system 10 has determined which page spreadis viewable by the user, the electronic learning device 20 may initiatean interactive play or learning activity with the user. For example, theelectronic learning device 20 may prompt the user to identify aparticular graphic image by touching the graphic image with his or herfinger. The position sensor 110 allows the electronic learning device 20to recognize the user's response, and respond in an appropriate manner,for example, with an audible response. The user may proceed to turn thebook 60 to another page spread and continue the interactive play orlearning experience. Preferably, each individual page spread has graphicimages relating to a separate theme, and the queries and responsesgenerated by the electronic learning system 10 correspond to theindividual page spread visible to the user. Therefore, a large number ofqueries and responses corresponding to the plurality of page spreads ispossible. Accordingly, the electronic learning system 10 is capable ofproviding a wide range of play and learning scenarios. From thisdisclosure, the artisan will recognize that multiple books 60 andcorresponding cartridges 50, each directed to a different theme orcharacter, could be provided to further expand the range of play andlearning activity possible with the electronic learning system 10.

The electronic learning system 10 preferably includes multiplefunctional modes selectable using the position sensor 110. For example,in a first functional mode, the electronic learning system 10 may simplerecite a story corresponding to written words disposed on the page orpages of the page spread visible to the user. From this disclosure, theartisan will recognize that other functional modes, for example modesdesigned to teach words, phonics, spelling and/or counting skills couldbe provided. The displays 40 may be used to indicate in which functionalmode the electronic learning device 20 is operating. Further descriptionof the functional modes may be found in co-pending U.S. patentapplication Ser. No. 10/448,583.

The electronic learning device 20 is preferably capable of audibilizingsound passages without the cartridge 50 inserted into the housing 22 orthe book 60 inserted into the book well 32. In a preferred embodiment, aplurality of indicia (not illustrated) corresponding to the Englishalphabet are disposed on an upper surface of the book well 32. With theelectronic learning device 20 turned on, and the cartridge 50 and book60 removed from the base unit 20, the controller 42 can be configured torespond to a user pressing on the book well 32 to select datacorresponding to a sound passage from the base unit memory 44 and tofurther audibilize the sound passage via the speaker 38. The soundpassage might be the name of a letter of the alphabet which the user hasjust pressed. Alternatively, the sound passage might be a musical note,a series of musical notes, or one or more spoken words.

From this disclosure, the artisan will recognize that the form of theopen holes 74 and closed holes 76 is not limited to the form illustratedin FIGS. 2, 4A-4G and 6. Open holes may or may not have a closedperimeter as do the open holes 74 or be individual at each hole locationas are the open holes 74 in the first embodiment book 60. With referencenow to FIG. 9, a first alternative book 60′ is illustrated, showing anupper portion of the second page spread 68 b. The inventive conceptsillustrated in FIG. 9 are not limited to the second page spread 68 b,but apply to each of the plurality of page spreads. In the firstalternative book 60′, as is most readily apparent relative with thefirst page 62 a, an elongated open perimeter hole in the form of acutout 75 elongated proximal a free (upper) edge of the page 62 a ismade spanning all of the adjacent locations of open holes 74 in the samepage of the first embodiment book 60 of FIG. 4B (that is hole locations72 b through 72 g). Furthermore, the elongated hole could be provided inthe form of an elongated slot with a closed perimeter as is indicated inphantom at 75′ in FIG. 9. The artisan will recognize that the elongatedhole, cutout 75 or slot 75′, is operationally equivalent to theplurality of adjoining individual open holes 74 positioned within theconsecutive adjoining hole locations 72 b through 72 g, as illustratedin FIG. 4B. That is, in operation, the emitter-detector pairs 122 do notdistinguish between a single open cutout 75 or slot 75′ spanningmultiple adjacent open holes 74, for example hole locations 72 b-72 gcorresponding to page identifier 82 b, and a plurality of individualopen holes 74 in those same hole locations 72 b-72 g.

FIG. 9 further illustrates use of elongated openings such as elongatedcutouts 75 spanning multiple adjacent open hole locations 74 wheremultiple pages are stacked on top of one another. A first cutout 75 insecond page 62 b spans hole locations 72 h-72 l. A second cutout 75 inthird page 62 spans hole locations 72 h-72 k. A third cutout 75 infourth page 62 d spans hole locations 72 h-72 j. In a similar manner, astair-step pattern is formed, with a cutout 75 in seventh page 62 gspanning only hole location 72 h. Again, each of these elongated cutoutscould be replaced by elongated slots (not depicted).

Finally, with reference now to FIG. 10, a second alternative book 60″ isillustrated, showing an upper portion of the second page spread 68 b. Aswith FIG. 9, the inventive concepts illustrated in FIG. 10 are notlimited to the second page spread 68 b, but apply to each of theplurality of page spreads. In the second alternative book 60″, an openhole location 74 is formed by an individual open perimeter cutout 79extending inwardly from a free edge (the top edge) of a given page. Inthis second alternative book 60″ the individual cutouts 79 have opposingstraight walls extending to a radiused innermost end.

The first and second alternate embodiment books 60′ and 60″ of FIGS. 9and 10 serve to illustrate the fundamental point that the open holelocations 74 and closed hole locations 76 can assume a variety of forms.An “open hole” simply indicates that for a given page spread, there isan absence of the page at the open hole location. Thus, when the book60, 60′, 60″ is in an operational position (such as within the book well32), no portion of the page 68 is positioned such that theemitter-detector pair 122 detects page structure within its zone ofdetection. Similarly, a “closed hole” indicates that when the book 60,60′, 60″ is in an operational position (e.g. within the book well 32), aportion of the relevant page of the book 60, 60′, 60″ is positioned suchthat the emitter-detector pair 122 detects the portion of the book/pagestructure. Within these general constraints, the artisan will recognizethat many different arrangements of the open hole locations 74 andclosed hole locations 76 are possible. For example, in addition to thealternative arrangements shown in FIGS. 9 and 10, the emitter-detectorspairs 122 and the corresponding hole locations 72 a-72 n could bearranged proximate one of the other free (i.e. non-hinged) edges, theside edges or bottom edge, of the book 60, 60′, 60″, or at some otherposition on the plurality of pages, rather than proximate the top freeedge. Furthermore, the page identifier codes could be formed by acombination of multiple alternative forms of the open hole locations andclosed hole locations, for example, a combination of the closedperimeter holes 74 of book 60, the open-perimeter cutouts 75 orclosed-perimeter slots 75′ of the first alternative book 60′ and/or theopen-perimeter cutouts 79 of the second alternative book 60″. Operationof the electronic learning system 10 is similar regardless of the exactform of the open hole locations 74 and closed hole locations 76.

From the foregoing it can be seen that the present invention is anelectronic learning device capable of receiving a book having aplurality of page spreads, each page spread having a unique pageidentifier code. The electronic learning device includes an optical pageidentification system capable of autonomously identifying each pagespread without requiring intervention by the user.

It will be appreciated by those skilled in the art that changes could bemade to the embodiments described above without departing from the broadinventive concept thereof. It is understood, therefore, that thisinvention is not limited to the particular embodiments disclosed, but itis intended to cover modifications within the spirit and scope of thepresent invention as defined by the appended claims.

All references, patent applications, and patents mentioned above areincorporated herein by reference in their entirety and are not to beconstrued as an admission that any of the of the cited documentsconstitutes prior art, or as an admission against interest in anymanner.

1. An electronic learning device for receiving a book having a pluralityof successive page spreads, at least one page spread having selectablecontent and an optically readable page identifier, the devicecomprising: a housing configured to receive the book; a position sensorin the housing, the position sensor configured to determine the locationof the selectable content on the at least one page spread; an opticalsensor in the housing, the optical sensor configured to irradiate anddetect the page identifier on the at least one page spread; controlelectronics in the housing, the control electronics operatively coupledto the optical sensor and to the position sensor, the controlelectronics configured to synchronize operation of the position sensorand the optical sensor.
 2. The device according to claim 1, wherein theposition sensor comprises a plurality of at least touch-responsive,mutually adjoining sensors organized in a two-dimensional array, thearray being formed by separate and separated first and second sets ofgenerally parallel, individual conductive lines transversely crossingover each other beneath an upper surface of the housing, a radiofrequency oscillating signal generator cyclically coupled to individualconductive lines of the first set; and a synchronous detection circuitoperatively coupled with the generator and with individual conductivelines of the second set to identify user selected individualcross-points of the first and second sets of lines of the array.
 3. Thedevice according to claim 1 wherein the optical sensor comprises anarray of optical emitter and optical detector pairs, a radio frequencyoscillating signal generator cyclically coupled to each individualoptical emitter, and a synchronous detection circuit operatively coupledwith the optical detectors.
 4. The device according to claim 1 whereinthe position sensor comprises a plurality of at least touch-responsive,mutually adjoining sensors organized in a two-dimensional array, thearray being formed by separate and separated first and second sets ofgenerally parallel, individual conductive lines transversely crossingover each other beneath an upper surface of the housing, a radiofrequency oscillating signal generator cyclically coupled to individualconductive lines of the first set; and a synchronous detection circuitoperatively coupled with the generator and with individual conductivelines of the second set to identify user selected individualcross-points of the first and second sets of lines of the array; and theoptical sensor comprises a plurality of optical emitter and opticaldetector pairs controlled and synchronized with the operation of theposition sensor by an optical switch and gate under the control of thecontrol electronics in the housing.
 5. An electronic learning devicecomprising: a page having an optical identification code and selectablecontent; a housing configured to support the page; an integrated sensorsystem configured to irradiate and detect the optical identificationcode and to detect the location of the selectable content; and controlelectronics in the housing, the control electronics operatively coupledto the integrated sensor system and configured to synchronize theirradiation and detection of the optical identification code and thedetection of the location of the selectable content and to produce anaudible response associated with the selectable content when the page issupported by the housing and the selectable content is selected.
 6. Theelectronic learning device according to claim 5, wherein the integratedsensor system comprises a position sensor and an optical sensor, theposition sensor comprising a plurality of at least touch-responsive,mutually adjoining sensors organized in a two-dimensional array, theoptical sensor comprising a plurality of optical emitter and opticaldetector pairs.
 7. The electronic learning device according to claim 6,wherein the optical sensor is controlled and synchronized with theoperation of the position sensor by an optical switch and gate under thecontrol of the control electronics in the housing.